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The microscopic probability distribution function of the Sherrington-Kirkpatrick 
(SK) model of spin glasses is calculated explicitly as a function of time by a high- 
temperature expansion. The resulting formula to the third order of the inverse temper- 
ature shows that an assumption made by Coolen, Laughton and Sherrington in their 
recent theory of dynamics is violated. Deviations of their theory from exact results are 
, estimated quantitatively. Our formula also yields explicit expressions of the time de- 

pendence of various macroscopic physical quantities when the temperature is suddenly 
l/^ ' changed within the high-temperature region. 

The dynamics of the Sherrington-Kirkpatrick (SK) model of spin glasses has been dis- 
cussed for many years. However, no explicit exact expressions of evolution equations have 
^ been given for macroscopic physical quantities such as the magnetization or susceptibility. 

Q I For a closely related problem, the dynamics of the Hopfield model of neural networks, 

O ' the situation is somewhat different. For a finite number of embedded patterns p, it is 

possible to write down a set of evolution equations of macroscopic order parameters explicitly. 
@i H; Hi Ifj on the other hand, the number of patterns p is proportional to the system size 
KnJ I TV, the problem is quite nontrivial and there has been no exact theory describing the time 

■ dependence of physical quantities. 

Coolen and Sherrington (CS) 0, |^ claimed to have derived the exact solution of this 
latter problem (in which p is proportional to N) using physical assumptions on the mi- 
croscopic probability distribution function. They assumed that the microscopic probability 
distribution function is a constant within a subspace in which a limited number of macro- 
scopic order parameters take fixed values. They called this property equipartitioning. In 
the equilibrium limit the equipartitioning property holds trivially because the Boltzmann 
factor is a constant for a given energy. In general nonequilibrium situations, however, it is 
not clear whether or not equipartitioning is a valid assumption. Ozeki and Nishimori 
showed by Monte Carlo simulations that numerical data for the noise distribution function, 
in terms of which the time evolution of macroscopic quantities is determined, deviate from 
the predictions of CS. Thus the method of CS yields approximations, not exact results, for 
the dynamics of the Hopfield model. CS then applied the same idea to the SK model, [|lOj 
and discussed the dynamics in terms of approximate closed-form evolution equations of a 
few macroscopic order parameters. 

The most recent development along this line is due to Coolen, Laughton and Sherrington 
(CLS). [0 |l^ This recent work is a sophistication of their previous method, using a contin- 
uous function instead of a few order parameters to describe the dynamics of the macroscopic 
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state of the system. The basic assumption of equipartitioning of the microscopic probabil- 
ity distribution function remains essentially intact. More precisely, they assumed that the 
microscopic probability distribution function pt(cr) is a constant (i.e., it does not depend on 
the spin configuration a) once the value of the single-site spin-field distribution function 

i 

is given, where the local field is 

hiicr) = ^ Jijaj. (2) 

They conjectured, based partly on comparison with numerical data, that this sophisticated 
version is either exact or a very good approximation. 

In the present letter we solve the master equation of the SK model explicitly by a high- 
temperature expansion. The resulting formula for the microscopic probability distribution 
function shows that the assumption of equipartitioning is violated. Thus the CLS theory is 
not exact even in its sophisticated form. We derive quantitative estimations of deviations 
of their theory from exact results. We also show that our formula is useful for predicting 
the behavior of physical quantities after a sudden change of temperature within the high- 
temperature region. 

The SK model is described by N Ising spins interacting with each other via random 
infinite-range interactions J^ : 

H{cr) = - ^ Jij<Ti(7j. (3) 

Jij represents quenched disorder, the values of which are obtained independently from a 
Gaussian distribution with mean Jq/N and variance J'^/N. The microscopic probability 
distribution function pt (a) obeys the master equation 

-^^pti^) = ^^y2ptiPk<y)wk{Fka) ~y2^k{<y)- (4) 

pt{a)dt Pti'^) k k 

Here F-^ is a single spin flip operator 

Ffc<I>(cr) = $(cri,---,-crfc,---,(TAr) 

and the transition rate is defined by 

^fc(^) = ^ {1 ^ '^A;tanh/3ft,fc(cr)} . (5) 

The inverse temperature is denoted as /3. 

Let us solve the master equation (^) by a high-temperature expansion in the form 

Pt[G) = exp {pftia) + p^gtia) + (3^ut{a) + • • •} (6) 

under the initial condition 

Pt=o{<j) = exp{-/3oi/(a)}. (7) 

Normalization of the distribution function is irrelevant for the following argument. In- 
serting eq. (H) into the master equation (||) and expanding the result in powers of /3, we 
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obtain the right-hand side of the master equation as 
—^y^Pt{FkCr)wk{Fk<T) - y^ Wk{cr) 

~ ^|l+/3Afc/t+/32Q(Afe/02 + Afc5, 

+ (3^ Q(Afc/t)' + AkftAkgt + Akut^ + . . .| i j^i + fjakhk - + 
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k ^ ^ 

where A^ft = ft{Fk<y) - ft{cr), and similarly for AkQt and AkUt- 

To evaluate the first-order term ft{(j) in eq. we retain only the terms proportional 
to (3 in eq. (||) and compare these with the left-hand side of eq. (||). The result is 

^ = i^A,/,-2i/(a). (9) 

k 

The following form is a possible solution of this equation: 

ft{<y)^a{t)H{<j). (10) 
Inserting eq. ( [lO| ) into eq. (^), we find 

a{t) ^ -2a{t) - 2. 

This equation is easily solved under the initial condition a{t = 0) = ~(3q/(3, which corre- 
sponds to eq. (|^), as 

ait) - f 1 - ^) - 1. (11) 



/3 

Since eq. is a first-order differential equation, the above expression ( |l0| ) with eq. (|l]) 
represents the unique solution. The first-order contribution has thus been obtained as 

Pt{o) = exp [{(/? - /3o)e-2* _ p}H{o)\ . (12) 



It is noted here that /?o should be at most of the same order as j3 because a{t) in eq. ( |10D 
has implicitly been assumed to be of order unity. 

Similarly, from the second-order term of (3 in eq. (H) , we have 

^ = 1 ^ Ak9t + (a^e-« - ae'^') J] hi (13) 
fc fc 

where a = 1 — (3q/ (3. This equation suggests a solution of the following form: 

gt{a)^b,{t)Y,hi + b2{t). (14) 



Inserting eq. (|lj) into eq. ( p^ ) and using the relation 



Ak{h.,f = ~Ah,J,k(Tk + 4jffe 
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we find 

bi{t) = -2bi{t) + a^e"^* - ae'^*. (15) 

Since the 62 (i) term in eq. (|lj) does not depend on the spin configuration and affects only 
the overall normalization of the probability distribution function (|^), we do not write down 
the evolution equation for 62 (i) here. The solution of eq. ( p^ ) is 

hit) = -^e-'^ - ( at - ^) e-'K (16) 



The initial condition is bi(t — 0) — because the first-order contribution, eq. (12), already 
satisfies the initial condition (^. 

The third-order term of (3 in eq. (p|) yields 
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+ (^a3e-6* - a^e-^*) ^ a^hl - 2{2ae-^* - l)b,it) ^ J^ih^hi. (17) 

k k,l 

The following form seems an appropriate solution of this equation: 

{t)H{a) + C2(i) J2 ^^hl + C3(0 J^jhrh,. (18) 

The first term of the right-hand side of eq. ( |l7| ) is calculated under the assumption ( [l^ ) as 
i J2^kUt=ci{t){-2H{a)} 



2 

k 



C2{t) I -4^ - l2J^H{a) ~AY,Jli<^km 



k,l 



+ Csit) < -2'Yjklhkhi + 2 ^ JklJkmJhn ^ ■ (19) 
I k,l k,l^ni 

The expressions including J^^ or JkiJkmJim do not appear in eq. (^8|). Thus eq. ( p^ may at 
first sight appear inappropriate as the solution of eq. (^7|). However, a simple order estimate 
using the relation 

Jo JZkl 

where Zki is a Gaussian variable with vanishing mean and unit variance, reveals that these J^- 
terms are at most of order Therefore these J^-contributions can be ignored compared 



to the other terms which are all of order N. In this way, we find that eq. (18) gives a 
consistent solution of eq. (^^ with coefficients satisfying 

ci{t) = -2ci{t) -12J^C2it) 

- AjHi{t){2ae-^^ - 1) 
C2{t) = -4c2(t) + ^a3e-«_^2g-4t 
c^{t) = -2c3(t)-2&i(i)(2ae-2t_i). 
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These differential equations are solved as 



3 ^ ' 

C3(t) = -ia3g-6t + (^3_ 1^2_2a2i)g-4t 



(20a) 
(20b) 

(20c) 



under the initial condition Ci = C2 = C3 = 0. 
We have obtained the probability distribution function of the SK model at high temper- 
ature as 



Pt[cr) 



exp 



+ C3 



'ij hj^hj 



(21) 



where a{t),bi{t), ci{t), C2{t) and c^it) are given in eqs. (|ll|), ( ]l6| ) and ( pOa| ) - ( |20c|) . The result 



(21) shows that there exists a term proportional to Jijhihj representing correlations of 



internal fields at different sites. 

One of the fundamental assumptions of the CLS theory ||ri|, |l2) is equipartitioning. That 
is, pt{<y) is assumed to be a constant in a subspacc with a given value of the single-site spin- 
field distribution function Z?(<r, /i) defined in eq. (|l|). Our result for pt{<y) shows that this 
assumption is violated because a constant D{<;,h) does not mean a constant value of the 
field-correlation term ^ Jijhihj. This term represents correlations of hi at different sites and 
hence cannot be expressed using only the single-site spin-field distribution function D{<;,h). 
Therefore the CLS theory is not exact. 

For a quantitative estimation of various terms in eq. (|l]) , we have plotted the coefficients 
a(t) to £3(1) in Fig. |l| for the initial condition Pq = 0. This figure shows that the coefficient 
csit) of the field-correlation term is not necessarily small compared to the others in some 
time regions, particularly around t = 2. Nevertheless, in many cases, the effects of the 
field-correlation term may not be apparent in physical observables written only in terms of 
Z)(<r, h), such as the internal energy and the magnetization. This would be one reason why 
the CLS theory predicts the time dependence of these physical quantities quite accurately, 
if not exactly, as shown numerically by CLS themselves. 

An interesting feature of our formula ( [2l| ) is that, for small /3 and /3o, Pt(o') is well 
approximated only by the first-order contribution given explicitly in eq. ([l^). The first- 
order term has the form of a Boltzmann factor exp{— Posit) H (a)} . Thus the system can be 
regarded as being in equilibrium with effective temperature Tcsit) = 1/Pes(t) at any given 
t. This allows us to calculate various macroscopic physical quantities in nonequilibrium 
situations using equilibrium statistical mechanics. An example is given in Fig. ^ for the 
time development of the internal energy in the case with Tq/J = 5 and T/J ~ 10. The 
center of distribution of the exchange interactions is Jq — 0. 

Concering the generality of the present method, although the SK model has been dis- 
cussed explicitly here, it is possible to apply the same technique to any models including 
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non-random systems and short-range models. The resulting form of the microscopic prob- 
ability distribution is almost independent of details of the model. Only minor changes in 
coefficients are sufficient in many cases. In particular, in the case of the Hopfield model, the 
appearance of various complicated terms in the probablity distribution explains why 
the simple two-parameter dynamics of CS (7[ || is not exact as found numerically. |^ 
One of the authors (H.N.) thanks Dr. Hiroshi Takano for useful discussions. 
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Figure 1 : Time evolution of the coefhcients of the high-temperature expansion. The initial 
condition is /3o = 0. We set J = 1. 



Figure 2: Time evolution of the internal energy for the initial and final temperatures T^/ J = 
5 and T/ J = 10, respectively. The center of of exchange interactions is Jq = 0. The dotted 
line represents the asymptotic value of the energy, E/N J = —0.05. 

For figures, access the following location (not the e-mail archive): 
http:/ /www.stat.phys.titech.ac.jp/hp/nishi/PSfigures/l 
or send your request to nishi@stat.phys.titech.ac.jp. 
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